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NAME:  Complex  Networks/Foundations  of  Information  Systems 


BRIEF  DESCRIPTION  OF  PORTFOLIO: 

Complex  Networks  and  Foundations  of  Information  Systems  uses  measured  information 
to  assure,  manage,  predict,  and  design  distributed  networks,  systems,  and  architectures 

LIST  SUB-AREAS  IN  PORTFOLIO: 

•  Local  Network  Research :  Coding  that  assures  information  delivery  and  security 

•  Network  Management  Research :  Network  and  system  protocols  to  maximize 
information  flow 

•  Global  Network  Research :  Predict  network  performance  and  design  robustness 

•  Foundations  Information  Systems  Research  (new  initiative  FY12):  Measure  and 
verify  information  system  properties 
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Complex  Networks  and 
Information  Systems  Roadmap 


Complex  networks  and  systems  uses  measured  information  to  assure,  manage, 
predict,  and  design  distributed  networks,  systems,  and  architectures 
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Complex  Networks  and  Systems 


Goals: 

•  Preserve  critical  information  structure  and  minimize  latency  over  a 
heterogeneous  distributed  network  and  system 

•  Ensure  network  and  system  robustness  and  stability  under  a  diverse  set  of 
resource  constraints  and  manage  not  assuming  static  models 

•  Find  invariant  properties  for  a  given  network  and  system  from  a  distributed  set 
of  observations  and  predict  network  behavior 

•  Develop  unifying  mathematical  approach  to  discovering  fundamental 
principles  of  networks  and  system  and  use  them  in  network  and  system  design 

Payoffs: 

•  Preserve  information  structures  in  a  network  rather  than  just  delivering 
packets  or  bits 

•  Quantify  likelihood  of  a  given  network  management  policy  to  support  critical 
mission  functions 

•  Predict  and  manage  network  and  system  failure  comprehensively 

DISTRIBUTION  A:  Approved  for  public  release;  distribution  is  unlimited. 
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Foundations  of  Information  Systems 

Program  Objectives 

-  Model  heterogeneous  distributed  systems  using  unified  mathematical  framework 
through  previous  measurement  and  validate 

-  Verify  the  properties  of  a  given  system  application  through  measurement  of  a 
limited  set  of  system  parameters  and  assess  mission  risk 

-  Define  general  architectural  principles  of  design  through  unified  assessment  of 
system  operating  properties 

-  Generalize  design  properties  to  universal  system  architectural  principles 


Payoff 

-  Assess  and  verify  properties  of  a  distributed  heterogeneous  system  where  there  is 
limited  access  to  its  elements 

-  Assess  dynamic  Air  Force  system  mission  performance  and  assess  risk  of  failure 
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Complex  Networks  Trends 


•  Local  Network  Theory 

-  Geometric  and  non-binary  information  coding  -► 

-  Coding  information  with  network  performance  objectives  ^ 

—  Integration  with  verification  and  quantum  methods  | 

•  Network  Management 

-  Nonparametric  strategies  for  assessing  network  performance  / 

—  Distributed  strategies  for  measuring  and  assessing  network  information 
transfer 

-  Sparse  network  management 

•  Global  Network  Theory 

-  Invariant  metrics  for  analysis  of  network  performance  / 

-  Geometric  flow  analysis  for  prediction  and  management  of  network  / 
performance 

-  Global  state  space  taxonomy  and  categorization 

•  Information  Systems  Research 

-  Combined  network,  software,  and  hardware  analysis  \ 

-  Defining  correct  input  data  for  given  mathematical  assessment  \ 
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Local  Network/System  Research:  Preserving 

Information  Content 


•  Statistical  geometric  coding  structures  are  used  to  transport  diverse  sets  of 
information  in  a  network  and  system  and  preserve  its  critical  structure 
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/.ess:  Latency/Computation/ 
Storage 

More:  Information  Loss 
With  Interference 


Sparse  Approximation 
for  Network  Codes 

Muriel  Medard,  MIT 


Approach:  Sparse  approximation  can  be  used  to  construct  sparse  codes  for  different  classes  of 
networks 

Payoff:  Sparse  approximation  criteria  such  as  information  coherence  can  be  used  to  guarantee 
different  quality  of  service  over  networks  without  retransmission 


Encoder  Architecture 


Sparse  decoder  can  set  different 
guarantees  for  information  recovery 
over  different  classes  of  networks  . 


Decoder  Architecture 
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Minimum  Interference  Coding 

Salman  Avestimehr,  Cornell 


Approach:  Specific  routing  path  configuration  of  networks  can  allow  superior 
throughput  of  information  based  on  a  geometrically  structured  code 

Payoff:  Information  transfer  becomes  more  independent  of  network  protocol 
performance  and  matched  to  time  evolving  network  properties 


Time  Sequenced  Code 
For  Multiplexed  Network 


time-slot  1  time-slot  2 


Network  Capacities 
Can  Be  Algebraically  Defined 

*3*  Definition:  A  scheme  achieves  normalized  sum-rate  of  ' a *  if  it 
achieves  a  sum-rate  satisfying 

i=  1 

for  all  networks  compatible  with  Q  (where 't'  is  a  constant) 

Specific  Network 
Capacity  Achieved 

*  The  normalized  sum-capacity,  a*(Q),  is  the  maximum  achievable  a 
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Network/System  Management  Research 
Guaranteeing  Information  Transfer 


The  state  of  information  transfer  on  a  network  changes  with  network  and  system  management 
policy  and  protocol 

-  Particularly  important  to  the  Air  Force  given  its  unique  heterogeneous  rnobile 
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Complex  Network  Information  Exchange  In  Random 
Wireless  Environments 

Pis:  A.  Goldsmith,  Yonina  Eldar 


Approach:  Most  physical  layer  network  management  routines  requires  complete  and 
independent  measurement  of  the  entire  signal  space  to  identify  and  decode  spectral 
transmission  sequences.  Sparse  approximation  with  feedback  can  greatly  reduced  the 
overhead  of  spectral  decoding. 


Payoff:  Dramatic  reduction  the  amount  of  spectrum  needed  and  computational  complexity  of 
creating  and  decoding  spectral  sequences  at  the  physical  layer  resulting  greater  capacity 
throughput  and  less  information  loss. 
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Algebraic  Spectral  Analysis  for  Resource 
Network  Resource  and  Stability  Analysis 

Igor  Mezic,  UCSB 


Approach:  Modalities  of  a  given  network  and  information  system  can  be  discovered  and 
characterized  using  algebraic  spectral  analysis 


Payoff:  No  analytic  model  and  very  little  a-priori  information  is  needed  to  characterize  a 
systems  operating  characteristics 


Network  Measurement  Projection  Operators 

Recall:  Projection  of  the  function  vx  on  the  j-th  eigenspace  can  be  obtained  as 
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Feedback  loops 
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Global  Network/System  Research:  Architecture 
Performance  Invariants  and  Prediction 


•  We  wish  to  develop  information  invariants  that  can  be  used  to  assess  network/ 
system  performance 
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Application  Tomography  With 
Operator  Algebras 

Jones,  Rokhlin,  Yale,  Ness,  Bassu  Telcordia 

Approach:  Software  applications  on  clouds  are  extremely  dynamic  and  can  cause 
system  failure  due  to  unpredictable  resource  usage.  Operator  algebraic  approaches 
can  be  used  to  track  these  applications. 


Payoff:  Dynamic  assessment  of  resource  failures  and  security  threats  can  be  tracked 
and  managed  in  real  time  by  measuring  binary  transactions  over  hardware, 
software,  or  network 


Operator  Theoretic 
Network  Representation 


Geometric  and  Statistical 
Network  Properties 


Applications  Mapped 
According  to  Information  Flow 


Step  1 .  Embed  the  data  set  in  JRd. 

Step  2.  Choose  a  value  of  a  to  define  a  length  scale.  Build  the 
graph  Laplacian  matrix  M  =  (exp{  -  |x;  -Xj|2/o}) 

Step  3.  Compute  the  eigenvectors  {<I>J. 

Step  4.  Carefully  choose  a  small  number  of  eiaenfunctions, 
e.g.,  ,  <I>4  ,  <I>7 .  The  new  data  set  represenfaf^^ 

by  the  image 

X,-  {<D,(Xi),  <t>4(x;),  07(x;)} 
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Graphlets 

Fan  Chung  Graham/UCSD 


Approach:  Graphs  are  typically  geometric  structures  that  do  not  have  properties  common  to 
continuous  analytic  models  of  systems.  Graphlets  bridge  this  gap  between  continuous  to 
discrete  geometry 


Payoff:  Network  and  system  data  can  be  decomposed  and  convolved  in  multiple  dimensions  to 
describe  network  and  system  properties  (multi-resolution  analysis  in  multiple  dimensions) 


Composeable  Set  of  Graphical  Representations 
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Analytic  Graphlet  Integration 
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Foundations  of  Information  Systems 


Measure  and  verify  information  system  properties  among  various  system  constraints 
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Mathematical  Unification  of 
Systems  Information  Transaction 

Syan  Mitra,  Gul  Agha,  University  of  Illinois  Center  for  Secure  Cloud  Computing 


Approach:  There  has  been  no  unified  mathematical  approach  to  network,  hardware,  and  software 
state  space  measurement  and  assessment.  These  areas  can  be  integrated  mathematically 


Payoff:  By  combining  finite  automata  theory,  fixed  point  theory,  and  geometric  information  theory, 
the  gaps  between  these  areas  can  be  bridged 


Analytic  and 
(Cyber)  Physical 
Computational  Models 
(Fixed  Point  Theory) 


Statistical  Measurement 
of  Networked  Assets 
(Geometric  Information 
Theory) 


Formal  Methods 
for  Software 
Verification 
(Automata) 


Mathematical 
Hybrid  System 
Representation 


System  Performance  State  Space 


x  =  ft(x) 


In v:  x  E  [0,5] 


1  Guard: 
fx  e  [3,5 J 


0  <  x  <  SAND 
at:  3  <  x  +  t  <  SAND 
x  +  t  +  1  =  x' 

After  quantifier  elimination 

0  <  x  <  5  AND 
x  +  1  <  x'  AND 
4  <  x'  <  6 


Reset 


System  Constraints 


Finite  State  Machine 


Collaboration  Between  AFOSR/AFRL-RI 


i  iE;t 


DISTRIBUTION  A:  Approved  for  public  release;  distribution  is  unlimited. 


Statistical  Category  Theory  of 
Dynamic  System  Data 

John  Harer/Sayan  Mukherjee  Duke  Konstantin  Mischaikow/Rutgers 


Approach:  Mathematically  going  from  sampled  system  data  to  parameterization  requires  a 
series  of  tools  that  handle  many  issues  from  statistical  and  topological  analysis  to  category 
theory 

Payoff:  Data  from  any  arbitrary  system  can  be  collected  processed  and  parameterized  as 
if  there  were  an  analytic  model  and  its  system  operating  modes  characterized 
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Computational  Homology  and  Ricci 
Flow  for  Verification  of  Computational  Systems 

Paul  Alsing/AFRL  Rl,  Howard  Bramson/Syracuse,  Warner  Millter,  FAU 


Approach:  There  is  no  unified  mathematical  approach  to  network,  hardware,  and  software 
state  space  measurement  and  assessment 

Payoff:  By  combining  finite  automata  theory,  fixed  point  theory,  and  geometric  information 
theory,  the  gaps  between  these  areas  can  be  bridged 
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Complex  Networks  Transition  Activities 


Complex  Networks  uses  advanced  mathematical  analysis  of  information  systems 
measurements  to  resource,  verify,  and  secure  distributed  Air  Force  infrastructures 

-  Princeton  MURI  -  dynamic  analysis  of  packets  for  airborne  network  resource  management 

-  Yale/Telcordia  commercial  grant  -  real  time  system  security  policy  verification 

-  Columbia/MIT  -  information  theory  for  new  quantum  semiconductors 
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Program  Impact  & 
Collaboration  with  Agencies 


•  OSTP/NITRD  -  Co-Chair  Large  Scale  Networks  Working  Group 

-  New  national  thrust  -  Complex  Networks  and  Systems  inspired  by  AFOSR 
program 

•  ASDR&E 

-  Engineered  Resilient  Systems  -  Complex  Networks  and  Foundations  of 
Information  Systems  on  Roadmap 

•  Secretary  of  the  Air  Force  Cyber  Horizons 


-  Lead  for  Enabling  Technologies 


*  DARPA  Collaboration/joint  program  reviews 

-  Graphs  -  Mathematics  of  graphs  and  networks  agent 

-  Defense  Science  Office  Mathematics  Board  of  Advisors 

-  InPho  -  Information  in  a  photon/quantum  network  collaborative  funding 

-  ITMANET  -  Joint  program  review  and  transition  agent 

•  IARPA  -  Quantum  Computer  Science  Working  Group 

•  ARL/ARO  Network  Science  Board  of  Advisors 

*  NSF  Future  Internet,  Net-Sci,  BECS  (Building  and  Engineering  Complex 
Systems),  NETS 
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Cyber  Operations:  Joint  University  Center  of  Excellence: 

"Cyber  Vision  2025"  -  Enabling  Technologies  workshops 
"Secure  Cloud  Computing"  with  university  and  AFRL/RI 

Dynamics  and.  Control :  Verification  and  Validation  of  Complex  Systems 

Physics  and_  Materials :  New  Joint  MURI  Topic:  "Large  Scale  Integrated 
Hybrid  Nanophotonics" 

Socio-Cultural  Analysis:  Social  Networks  -  Joint  MURI  Topic:  "Stable 
Metrics  for  Inference  in  Social  Networks  "  -  UCLA/USC/ASU 

Quantum :  Interaction  with  quantum  network  and  quantum  estimation 
processes  through  lab  tasks 


-  Joint  EOARD  initiative  at  Cambridge 


Information  Fusion :  Critical  feature  selection  in  sensor  networks 
Optimization:  Competing  optimization  requirements. 

Decision :  Networks  of  neurons. 


Biology:  Systems  biological  processes  as  networks. 
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Academia/Commercial  Outreach 


Keynote  Lecture,  American  Society  of  Mechanical  Engineers,  Complex 
Systems 


Keynote  Lecture,  International  Conference  on  Complex  Networks, 
2012 


Keynote  Speaker  IEEE,  International  Conference  on  Distributed 
Computing  Systems  (ICDCS),  Minneapolis,  Minn.,  2011 

Distinguished  Lecture:  University  of  Illinois  Coordinated  Science 
Laboratory  Dec  2011 

Track  Chair  IEEE  Milcom:  October  2011 

Invited  Speaker:  American  Institute  for  Mathematics  Workshop  on 
Geometry  of  Large  Networks,  Stanford,  Sep  2011 

Invited  Speaker:  Institute  for  Pure  and  Applied  Mathematics  (IPAM), 
UCLA,  Conference  on  Dynamic  Networks  Dec  2012 

Invited  Speaker:  Dagstuhl  Germany,  Mathematics  of  Network  Learning 
2011 

Invited  Speaker:  NSF  Conference  on  Cyber  Physical  Systems, 
September  2011 

Invited  Speaker:  USCD  Information  Theory  and  Applications,  LaJolla 
2012 

Organizer:  London  Institute  of  Mathematics:  Mathemal 
Statistical  Verjf  iqatiop,  Ma  rch  2012 AFRL> 


Recent  Program  Awards 


Vincent  Poor: 

-  Member,  National  Academy  of  Sciences  (elected  2011) 

-  Edwin  Howard  Armstrong  Achievement  Award,  IEEE  Communications  Society  (2011) 

-  IET  Ambrose  Fleming  Medal  for  Achievement  in  Communications  (2010) 

-  IET  Ambrose  Fleming  Medal  for  Achievement  in  Communications  (2010) 

Robert  Calderbank 

Elected  Dean  of  Science,  Duke  University  (2011) 

Joel  Tropp: 

-  Alfred  P.  Sloan  Research  Fellowship  (Mathematics) ,  2010 

-  Winner,  Sixth  Vasil  A.  Popov  Prize  (Mathematics),  2010 

Emmanuel  Candes: 

-  Collatz  Prize  (Mathematics) ,  (ICIAM)  2011 

-  Winner,  Sixth  Vasil  A.  Popov  Prize  (Mathematics) ,  2010 

Rob  Nowak 

-  IEEE  Fellow,  2010 

Mung  Chiang: 

IEEE  Fellow  2012 

-  IEEE  Kiyo  Tomiyasu  Award  in  2012 

Junshan  Zhang 

-  IEEE  Fellow  2012 

Jennifer  Rexford: 

SIGMETRICS  "Test  of  Time"  award  (Computer  Science)  (2011) 


i 
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Transition  Activities 


•  AFRL 

-  AFRL/RI  -  Cyber  Vision  2025  workshops/Illinois  Center  for  Secure 
Cloud  Computing/ 

-  AFRL/RI/RY  -  DARPA  InPho  program/DARPA  Graphs  program 

-  AFRL/RI/RY/RV  -  distributed  secure  space  communications 

-  AFRL/RW/RV/RH  -  verification  and  validation  of  complex  systems 


•  STTR 

-  Intelligent  Automation:  Transition  to  ESC  of  Airborne  Networks 
management  -  transition  to  Boeing  for  test-bed 

-  Avirtek:  Secure  router  application  interface-  AFRL/RI 

-  Andro  -  Joint  Spectrum  Center  Lockheed  transition  of  automated 
spectrum  management  tool 
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Transition  Activities 


•  Customer/Industry 

-  Collaboration  with  ACC/GCIC,  Air  Force  Spectrum  Management 
Agency  on  JALIN  ICD 

-  Collaboration  with  Boeing,  ESC,  IAI  for  transition  of  coding  and 
routing  management  protocols  baseline  CORE  tools  to  Rome 
Lab  for  possible  integration  in  CABLE  JCTD 

-  Briefing  to  Space  Command/Peterson  for  potential  collaboration 

-  Interaction  with  Northrop  Grumman/BACN  airborne  networking 
program  for  potential  collaboration 

•  OSD 


-  Complex  Systems  Engineering  and  Systems  20/20  initiative 

-  Software  Assurance  and  Security  Initiative 

-  Robust  Command  and  Control  Initiative 


•  Commercial 


-  New  initiatives  with  Akamai  for  content  distribution  analysis 

-  Interaction  with  USFA/DHS/CISCO  on  router  algorithm  design 


DISTRIBUTION  A:  Approved  for  public  release;  distribution  is  unlimited. 


Transition  Activities 


•  DCT 

-  AFRL/RI  -  Lab  tasks/Joint  Emulab  research  center  AFRL/RI  online  January  2010 

•  Integration  of  MURI  -  "Information  Dynamics  in  Networks"  with  AFRL  Emulab  through 
Princeton/UC  Irvine 

•  Transition  of  Yale  diffusion  map  to  AFRL/RI  for  network  analysis 

•  Network  management  and  coding  interaction  with  ACC  -  Jim  Lehnert  Purdue/Len 
Cimini  Delaware/Andrea  Goldsmith-Stanford 

-  AFRL/RW  -  weapons  tactical  data  links  interaction  -  Chad  Jenkins/Brown 

-  AFRL/RH  -  social  network  analysis  interaction  -  Michael  Mahoney/Stanford 

-  AFRL/RY  -  collaboration  with  for  transitions  in  network/software  policy  and  management  - 
Larry  Carin  -  Duke 

•  STTR 

-  Transitions  between  STTR/AFRL/ESC/Boeing  under  STTR  IAI  activity  -  interactions  with 
AFRL/RI 

-  STTR  ANDRO  Computational  Research  interaction  with  OSD/NII/NTIA/ARL  CERDEC  for 
spectrum  planning  research  -  interaction  with  AFRL/RI 

-  Interaction  with  Princeton/ASU  with  IAI  for  integration  of  STTR  work 
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Backup 


w 


Complex  Networks  Transition 
Organization 


Complex  Networks  has  an  integrated  transition  strategy 


f  =1  /(Information 
Timescale  At) 


Complex  Networks 


AFRL  Lab  Tasks/ 
AFRL/RI  -  Emulab  Center 


Customer  Interaction 

ACC/ASC/ESC/AMC 

/Joint 

Emulab  ESC/Hanscom 
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Motoric  Operations 


Axioms  of  Fairness 
in  Cloud  Architectures 

Approach:  There  is  no  unified  mathematical  approach  to  network,  hardware,  and  software 
state  space  measurement  and  assessment 

Payoff:  By  combining  finite  automata  theory,  fixed  point  theory,  and  geometric  information 
theory,  the  gaps  between  these  areas  can  be  bridged 


"  (  \ 1  3 
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0 

/s(x)  =  sign(l  -  /?)  ■ 

[ste-,)  J 

Min-Max 
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Entropy 

Jain's  Index  Jasso  Index  Proportional  Fairness  Max-Min 


/ 3 

-1  0  1  +oo 


Theil  Index,  Atkinson  Index  (e) 

{//?(x,  q),  (3  =  1  -  e,  ©  =  A,  r  =  - 1} 


!  i  1 


Renyi  Entropy  (a) 

{Fp, a(x),  a  =  -1,  (3=1  -  a} 


Foster-Sen  Welfare  Function 

{^/3,a(x,  q),  A  =  1,  (3  =  1  -  e,  qt  = 
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Codes  Using  Algebraic  and  Linear  Programs 
For  Distributed  Cloud  Resource  Allocation 

Approach:  There  is  no  unified  mathematical  approach  to  network,  hardware,  and  software 
state  space  measurement  and  assessment 

Payoff:  By  combining  finite  automata  theory,  fixed  point  theory,  and  geometric  information 
theory,  the  gaps  between  these  areas  can  be  bridged 


maxri  +  ...  +  r$ 

Bandwidth  constraints 

ri  +  r2  <  1 
7*3  +  r4  <  1 
7*5  +  r6  <  1 


I A1  +  /si  <  1 

n  <  Iai 

f  A2  +  /S2  <  1 

72  <  f  Bi 

/A3  +  f  B3  <  1 

* 

• 

• 

Storage  Availability 

constraints  constraint 
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KKT  conditions 
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Primal-Dual  Solution 
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